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What Is NAEP? 



T he National Assessment of Educational Progress (NAEP) is the only 
nationally representative and continuing assessment of what America’s 
students know and can do. It is a congressionally mandated project of 
the U.S. Department of Education’s National Center for Education Statistics. 
NAEP measures student achievement in reading, mathematics, writing, sci- 
ence, U.S. history, geography, civics, the arts, and other subjects. Since 1969, 
NAEP has surveyed the achievement of students at ages 9, 13, and 17 and, 
since the 1980s, in grades 4, 8, and 12. 

The National Assessment Governing Board 

The National Assessment Governing Board (NAGB) was created by Con- 
gress to formulate policy for NAEP. Among the Board’s responsibilities are 
developing objectives and test specifications and designing the assessment 
methodology for NAEP. 
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Chapter One 



Overview 



Introduction 

S ince 1973, the National Assessment of Educational Progress 
(NAEP) has gathered information about levels of student pro- 
ficiency in mathematics and the related practices of teachers 
in our nation’s schools. The results of these periodic assessments 
are published in The Nation ’s Report Card to inform citizens about 
the nature of students’ comprehension of the subject, curriculum 
specialists about the level and nature of student understanding, and 
policymakers about factors related to schooling and its relationship 
to student proficiency in mathematics. 

Based on these surveys of students at the end of elementary, mid- 
dle, and high school, The Nation s Report Card has provided com- 
prehensive information about what students in the United States 
know and can do in the area of mathematics and in several other 
subjects. These reports present information about strengths and 
weaknesses in students’ understanding and their ability to apply 
that understanding in problem-solving situations; provide compara- 
tive student data according to race/ethnicity, type of community, 
and geographic region; describe trends in student performance over 
time; and report relationships between student proficiency and cer- 
tain background variables. This framework document describes the 
content and format of the NAEP mathematics assessments in 1996, 
2000, and 2003. Although there have been revisions to the frame- 
work, NAEP has maintained the mathematics trend begun in 1990. 

Context for Planning the Mathematics Assessment 

The National Assessment Governing Board (NAGB), created by 
Congress in 1988, is responsible for formulating policy for NAEP. 
NAGB is specifically charged with developing assessment objec- 
tives and test specifications, identifying appropriate achievement 
levels, and carrying out other NAEP policy responsibilities. In 1990, 



the U.S. Department of Education conducted the first voluntary 
state-by-state assessment of mathematics as an adjunct to its periodic 
NAEP national assessments of mathematics. The 1990 state-level 
trial was limited to the 8th grade. In 1992, the second voluntary 
state-level assessments associated with NAEP were carried out at 
the fourth- and eighth-grade levels in mathematics and at the fourth- 
grade level in reading. Current NAEP legislation in the No Child 
Left Behind Act of 2001 requires that NAEP assess mathematics 
and reading every two years at the national and state levels in 
grades 4 and 8. This schedule begins with the 2003 assessment. 

To prepare for the 1990 trial state assessment, the National Center 
for Education Statistics awarded a contract in 1987 to the Council 
of Chief State School Officers (CCSSO) to design a framework for 
the assessment. The Mathematics Framework Project gave special 
attention to the nature of formal state objectives and frameworks for 
mathematics instruction. In doing so, the Framework panels sampled 
state-, district-, and school-level objectives; examined the curricular 
frameworks on which previous NAEP assessments were based; con- 
sulted with leaders in mathematics education; and reviewed a draft 
version of the National Council of Teachers of Mathematics (NCTM) 
Curriculum and Evaluation Standards for School Mathematics. This 
project resulted in the “content-by-mathematical-ability” matrix 
design used to guide both the 1990 and 1992 NAEP mathematics 
assessments. 

To prepare for the next NAEP mathematics assessment, NAGB 
awarded a contract in fall 1991 to The College Board to develop 
assessment and item specifications for the 1994 mathematics 
assessment. 

The process of developing the recommendations for the planned 
1994 NAEP mathematics assessment occurred between September 
1991 and March 1992. Because of a budget shortfall, however, both 
the new NAEP mathematics and science assessments were resched- 
uled from 1994 to 1996. 

The NAEP mathematics project conducted by The College Board 
had two primary purposes. The first was to recommend a framework 
for the overall design of the mathematics assessment — that is, a 
structure for describing what students should know and be able to 



do in mathematics. The second was to develop specifications for 
the assessment items, with particular attention to a mix of formats, 
the item distribution for content areas within mathematics, and the 
conditions under which items are presented to students (e.g., use 
of manipulatives, use of calculators, and other factors). 

The new NAEP Mathematics Framework was considered in 
light of the three NAEP achievement levels — Basic, Proficient, 
and Advanced. 



Achievement Levels 

Basic denotes partial mastery of prerequisite knowledge and 
skills that are fundamental for proficient work at each grade. 

Proficient represents solid academic performance for each 
grade assessed. Students reaching this level have demonstrated 
competency over challenging subject matter, including subject- 
matter knowledge, application of such knowledge to real-world 
situations, and analytical skills appropriate to the subject matter. 

Advanced represents superior performance. 

These levels are intended to provide descriptions of what students 
should know and be able to do in mathematics. Established for the 
1992 mathematics scale through a broadly inclusive process and 
adopted by NAGB, the three levels per grade are the primary means 
of reporting NAEP data. The new mathematics assessment was con- 
structed with these levels in mind to ensure congruence between the 
levels and the test content. See appendix A for the NAEP Mathe- 
matics Achievement Level Descriptions. 
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Framework and Specifications Development Process 

The College Board convened a steering committee representing 
national education organizations, policymakers, and business to re- 
view the direction and scope of the project. A planning committee 
of mathematics educators met to draft the assessment framework. 
Both committees considered (1) the status of national reform ef- 
forts in mathematics education and assessment evaluations of the 
NAEP trial state assessment in mathematics (Silver, Kenney, and 
Salmon-Cox, 1991) and (2) tile fit between NAEP assessments and 
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the teaching of mathematics at grades 4, 8, and 12 in the nation’s 
schools (Romberg, Wilson, Smith, and Smith, 1991). Committee 
members are listed in appendix B. 

The suggested revisions in the framework are intended to reflect 
the 1990 and 1992 NAEP assessments. Committee members also 
made use of the findings of evaluation studies concerning the NAEP 
assessments. The findings of these studies were merged with re- 
search and state standards for the assessment of student proficiency 
in mathematics. Finally, the committee reviewed information pro- 
vided by the 1990 assessment, noting features of the framework and 
how those features assisted or hindered the clear understanding of 
what students knew and were able to do in mathematics appropri- 
ate to their ages and levels of education. Another important phase 
in the process involved conducting a national mail review and con- 
vening focus groups in six states to gather input on the committee’s 
recommendations. 

The suggested revisions in the framework for the new NAEP as- 
sessment in mathematics are intended to reflect curricular emphases 
and objectives; include what various scholars, practitioners, and in- 
terested citizens believe should be in the assessment; and maintain 
ties to previous assessments to permit the reporting of trends in stu- 
dent achievement across time. 

Recommendations for the 1996 and Future NAEP 
Mathematics Assessments 

As a result of analysis and review, the steering committee and 
planning committee endorsed the following recommendations for 
the 1996 and future NAEP mathematics assessments: 

1. Content Strands 

The matrix framework employed in the 1990 and 1992 NAEP 
assessments should be discontinued in favor of a model con- 
sisting primarily of the five major content strands used in that 
matrix model. Evaluation studies of the NAEP trial state as- 
sessment and other cognitive science recommendations deal- 
ing with assessment suggest that forcing content into a rigidly 
structured, content-by-ability-level matrix distorts the nature 
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of the discipline. A model that calls for the assessment of 
knowledge in discrete, content-by-ability-level categories is 
inappropriate in an era in which more progressive recommen- 
dations call for attention to a student’s ability to connect knowl- 
edge in one area of mathematics with knowledge and abilities 
in other areas of mathematics. 

Therefore, the recommendation was to use the five major con- 
tent strands: (1) Number Sense, Properties, and Operations; 

(2) Measurement; (3) Geometry and Spatial Sense; (4) Data 
Analysis, Statistics, and Probability; and (5) Algebra and 
Functions. These strands have their foundation in NAEP 
mathematics assessments beginning in the 1970s. The nature 
of the strands is further discussed in chapters two and three. 

2. Mathematical Abilities 

The levels of mathematical ability (conceptual understanding, 
procedural knowledge, and problem solving) should not be 
used to define specific percentages of items in each of the five 
content strands, as was done in the 1990 and 1992 assessments. 
However, these descriptors, along with the more encompassing 
process goals of reasoning, connections, and communication, 
should play a central role in defining item descriptors and 
achieving balance across the tasks for each grade level in the 
NAEP mathematics assessment. This recommendation is dis- 
cussed further in chapters two and four. 

3. Percentage of Items 

The percentage of items allotted to each of the five strands 
should continue the move begun with the 1990 assessment 
toward a balance among the five strands and away from an 
assessment dominated by number and operations. The recom- 
mendations, although retaining a core of items that reflect 
traditional goals in the Basic skills, represent continued 
movement toward a broad algebra- and geometry-oriented 
program at the eighth- and twelfth-grade levels. The specific 
percentage of items recommended is further discussed in 
chapter two. 

me i2 
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4. Item Families 

To measure the breadth and depth of student knowledge in 
mathematics, “families” of tasks/items should be created for 
each grade level of the assessment. A family of tasks/items is 
a related set of assessment tasks that can probe the vertical or 
horizontal nature of a student’s understanding. A vertical fam- 
ily might include items that measure students’ abilities to de- 
fine a concept, apply the concept in a familiar setting, use the 
concept or related principles to solve a new problem, and ulti- 
mately generalize knowledge about the concept or related 
principles to represent a new level of understanding. A verti- 
cal family might lie within a single grade level or extend 
across grade levels. Another family of items might measure 
students’ horizontal understanding of a concept or principle 
across content strands. For example, students’ proficiency in 
solving the proportion 2/3 = 16/x might be measured in a 
number context, in a measurement setting, in a geometry set- 
ting, in a probability setting, and in an algebraic setting. Stu- 
dents’ ability to work with, the proportion in each of these 
contexts tells a great deal about the richness of their under- 
standing of the concept and the related procedural skills. 

5. Constructed-Response Items 

The number of items requiring students to construct a response 
should be increased as much as possible within the bounds of 
the statistical design used to carry out the assessment. Further- 
more, these items provide excellent opportunities to measure 
students’ abilities to reason mathematically as well as connect 
and communicate their knowledge of mathematics. In particu- 
lar, the number of extended open-ended items should be in- 
creased from the number given in the 1992 assessment. 

6. Special Studies 

At the twelfth-grade level, a special study should be carried 
out using graphing calculators to establish baseline data for 
gradually introducing these calculators, which can assist stu- 
dents in visualizing algebraic relations, into the curriculum. 



7. Manipulatives 

The assessment should continue using reasonable manipulative 
materials, where possible, to measure students’ knowledge and 
problem-solving abilities. Such manipulative materials and 
accompanying tasks should be carefully chosen to minimize 
disruption of the test administration process. 

8. Item Bias Review 

Although bias analysis is consistently conducted on NAEP 
items and student performance as mandated by law, recommen- 
dations for shifting the types of items used on the assessment 
merit an especially careful look at potential item bias. Data 
should be gathered during field testing and during the actual 
assessment and analyzed for any unforeseen item bias that may 
arise from incorporating less widely used types of assessment 
items. The 1996 and future NAEP assessments will incorporate 
awareness of this critical consideration, especially related to 
students’ previous opportunities to learn and their experience 
and background both in school and outside of school. Sensi- 
tivity and a sound research base will guide not only test con- 
struction but also the reporting of student performance. 

These recommendations were made in an attempt to reflect the 
increasing realization that student proficiency in mathematics is not 
the result of the interaction of discrete cells of knowledge with a 
discrete list of special mathematical abilities. Rather, student profi- 
ciency in mathematics results from broad experience in forming 
networks of connections among mathematical ideas and skills. The 
current framework and specifications reflect a more integrated view 
of school mathematics than previous NAEP frameworks. 

Note: For the 2005 mathematics assessment, the Governing Board 
conducted a comprehensive Framework Update Project to further 
enhance the current framework and specifications. Although changes 
were recommended at grades 4 and 8, these modifications are not 
expected to disrupt the trends begun in 1990. More substantial 
changes were recommended for the 12th-grade assessment. Refer 
to the NAGB Web site at www.nagb.org for further information on 
the 2005 Mathematics Framework. 



Chapter Two 



Framework for the Assessment 



Content Strands 

T his chapter further discusses the rationale for recommen- 
dations presented in chapter one. The framework for the 
NAEP mathematics assessment is anchored in broad 
strands of mathematical content: 

• Number Sense, Properties, and Operations 

• Measurement 

• Geometry and Spatial Sense 

• Data Analysis, Statistics, and Probability 

• Algebra and Functions 

These strands are not intended to divide mathematics into dis- 
crete elements. Rather, they are intended to provide a helpful clas- 
sification scheme that describes the full spectrum of mathematical 
content assessed by NAEP. 

Mathematical Dimensions 

The 1990 and 1992 NAEP mathematics assessments made use 
of matrix frameworks to specify items by both content strand and 
mathematical ability, as shown in figure 1 . The use of such frame- 
works provided strong guidance for the construction of the assess- 
ment in terms of breadth. Nonetheless, this type of structure tended 
to work against the curricular goal of integrating mathematical 
knowledge across topics. 



Figure 1. Framework for the 1990 and 1992 Mathematics 
Assessments 
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Additionally, on secondary analyses of the NAEP items, expert 
panels often had difficulty replicating the assignment of items to 
cells of the matrix on the basis of the mathematical ability classifi- 
cations. Classifications varied with the rater’s conceptions of stu- 
dents’ abilities of children in grades 4, 8, or 12 rather than with the 
definitions of the mathematical abilities. The strict application of the 
mathematical abilities classifications in conjunction with the con- 
tent strands led to a forced fit of items to achieve balance across 
the two-dimensional matrix rather than to match the goals of math- 
ematics education. 

In real life, few mathematical situations fall clearly in one con- 
tent strand or another, and few naturally reflect only one facet of 
mathematical thinking. Yet, to ensure a broad scope in test construc- 
tion, items must be classified several ways. To address this issue of 
item classification, the current framework for mathematics assess- 
ments focuses primarily on the mathematical content strands, with 
additional specifications related to an assessment dimension re- 
ferred to as “mathematical power,” as shown in figure 2. 

Figure 2 shows that the curriculum is conceived as consisting of 
content drawn from five broad mathematical areas. Items are clas- 
sified according to the major area(s) they address, including both 
mathematical abilities and mathematical power. Mathematical 



Figure 2. Framework for the 1996, 2000, and 2003 Mathematics Assessments 
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Reasoning Connections 1 Communication 



power is conceived as consisting of mathematical abilities (concep- 
tual understanding, procedural knowledge, and problem solving) 
within a broader context of reasoning and with connections across 
the scope of mathematical content and thinking. Communication is 
viewed as both a unifying thread and a way for students to provide 
meaningful responses to tasks. 

In recent NAEP administrations, the concept of mathematical 
power as reasoning, connections, and communication played an 
increasingly important role in measuring student achievement. In 
1990 , the assessment included short-answer open-ended items as 
a way to begin to address mathematical communication. The ex- 
tended open-ended items included on the 1992 assessment required 
students not only to communicate their ideas but also to begin to 
demonstrate the reasoning they used to solve problems. The new 
assessment items focus even more attention on mathematical power 
by continuing deliberate attention to reasoning and communication 
and by providing students with opportunities to connect their learn- 
ing across mathematical content strands. These connections are 
addressed through individual items designed to tap more than one 
content strand or more than one ability, as well as across items 
through the use of item families. 

Families of Items 

Families of related items were designed to sample the depth of 
students’ knowledge within a particular strand and students’ abil- 
ity to deal with concepts, principles, or procedures across content 
strands. Within a family, items may cross content areas, mathemati- 
cal abilities, and/or grade levels. This type of grouping in the de- 
sign of the assessment allows a more indepth analysis of student 
performance than would a collection of discrete items. Individual 
student performance, comparisons of student performance across 
grade levels and strands, and comparisons of student performance 
across assessments with respect to a family of items provide anoth- 
er way to assess areas of strength and weakness. 

A more detailed discussion of each content strand is provided 
in chapter three, and more detailed descriptions of item types are 
provided in chapter five. 
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Percentage of Items 

The distribution of items among the various mathematical con- 
tent strands is a critical feature of the assessment design, as it re- 
flects the relative importance and value given to each strand. In the 
past six NAEP assessments in mathematics, the categories received 
differential emphasis, and the differentiation continues in the frame- 
work for the 1996, 2000, and 2003 assessments. The recommended 
distribution of items to the strands continues to move toward a more 
even balance among the strands and away from the earlier model, 
in which items reflecting number facts and operations composed 
more than 50 percent of the assessment item bank. 

Another significant difference in the new assessment is that items 
may be classified in more than one strand. In addition to describing 
minimum percentages of the item pool that should address each 
strand, note that maximum percentages are listed for the Number 
Sense, Properties, and Operations strand to ensure that the balance 
is maintained. Table 1 provides the recommended mix of items in 
the assessment by content strand for each grade (4, 8, and 12). 

These guidelines for balance present a minimum target for repre- 
sentation across mathematical content strands. For Number Sense, 
Properties, and Operations, note that a maximum target is also pro- 
vided. This target is intended to reinforce the shift away from a 
narrow number and computation focus to a more comprehensive 
view of mathematics. An item should be classified according to its 
predominant strand; it may be classified under two or more strands 
if it addresses substantive content from more than one area. In fact, 
at least half of the new items should have major elements drawn 
from more than one strand, and they should be categorized in those 
strands. This means that the percentages listed in table 1, when 
translated into data on the actual item pool, will result in a per- 
centage of items greater than those listed and will add up to more 
than 100 percent. Additionally, the number of items reflecting 
connections among strands should continue to increase in subse- 
quent assessments to move NAEP assessments ever closer to the 
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Table 1. Minimum Percentage Distribution of Items, by Grade 
and Content Strand 



Content Strand 


Grade 

4 


Grade 

8 


Grade 

12 


Number Sense, Properties, and Operations* 
(minimum/ maximum) 


40/70 


25/60 


20/50 


Measurement 


20 


15 


15 


Geometry and Spatial Sense 


15 


20 


20 f 


Data Analysis, Statistics, and Probability 


10 


15 


20 


Algebra and Functions 


15 


25 


25 



Note: An item may be classified in more than one category. 

*At least half of the items in Number Sense, Properties, and Operations at each grade level 
should involve some aspect of estimation or mental mathematics. No more than the specified 
maximum percent of the items at any grade level should have a major classification in this 
strand. 

f At grade 12, 25 percent of the items in the geometry strand should involve topics in coordi- 
nate geometry. 



goal of students having the opportunity to demonstrate mathemati- 
cal power in various situations requiring connections within mathe- 
matics and with other disciplines. 

Figure 3 shows the percentage of items by content strand and 
grade level on the NAEP mathematics assessment. The emphasis 
given to Number Sense, Properties, and Operations in grade 4 
shifted toward growing emphases in Geometry and Spatial Sense; 
Data Analysis, Statistics, and Probability; and Algebra and Func- 
tions in the later grades. 
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Figure 3. Percentage of Items, by Content Strand and Grade 
Level (Minimum percentages shown) 
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Number Measurement Geometry Data Analysis, Algebra 

Sense, and Spatial Statistics, and 

Properties, Sense and Probability Functions 

and Operations 

Item Balance 

Mathematical power can be thought of as an extension of “mathe- 
matical abilities,” as the term was used in the 1990 and 1992 mathe- 
matics assessments. The mathematical abilities described in the 
framework for these assessments (procedural knowledge, conceptual 
understanding, and problem solving) specifically addressed aspects 
of knowing and doing mathematics. Nonetheless, the development 
of assessment items based only on a rigid content-by-process ma- 
trix has led to a contrived separation and artificial contexts. Indeed, 
expert reviewers of the 1990 assessment often were unable to agree 
on the best placement for some items in the framework matrix. 

The current specifications are designed to incorporate the over- 
arching standards for communicating, reasoning, and connecting, 
as well as the categories of conceptual understanding, procedural 
knowledge, and problem solving. The following recommendations 
are intended to guide the development of actual items for the 1996 
and future NAEP mathematics assessments. These guidelines are 



provided to assist in reviewing the overall balance in the assessment 
and ensure that the assessment reflects some balance among “know- 
ing that or knowing about,” “knowing how,” and “solving problems,” 
within an overall demonstration of mathematical thinking in vari- 
ous situations. Chapter four includes a more indepth discussion of 
mathematical power, mathematical abilities, and additional aspects 
of mathematical thinking as they relate specifically to the current 
and future mathematics assessments. 

Guidelines for balancing the mix of conceptual understanding, 
procedural knowledge, and problem-solving items should be evalu- 
ated only in terms of the total item package at each grade level, not 
in each individual strand. As in the content classification, classifi- 
cation according to these three mathematical abilities need not — 
in fact should not — be forced into individual categories. Rather, an 
item will likely include elements of more than one of these three, 
and it should be classified in as many of these categories as is ap- 
propriate for the major thought processes required. 

At each grade level, at least one-third of the items should be 
classified as conceptual understanding, at least one-third should be 
classified as procedural knowledge, and at least one-third should be 
classified as problem solving. Items with a major element of proce- 
dural knowledge in addition to either conceptual understanding or 
problem solving should not make up the majority of items at any 
grade level. 

To present a more complete picture of national mathematics 
performance, there should be an increase in the total number of 
items in the assessment and the number of items requiring student- 
constructed responses. In particular, any increase should reflect at 
least a doubling of the number of extended open-ended items con- 
tained in the 1992 NAEP assessment and an attempt to equalize the 
number of short-answer and multiple-choice items. 

The percentage distributions presented here, the lists of topics 
provided in chapter three, and the described elements of mathemati- 
cal power are not intended to prescribe curriculum standards; rather, 
they are designed to construct a complete and balanced assessment 
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instrument reflecting best practice in mathematics education at each 
grade level. An analysis of student performance across all items will 
permit NAEP to report on average mathematics proficiency. In ad- 
dition, analysis of performance on subsets of items will permit re- 
porting on patterns of achievement in each of the five strands. 

Calculators 

In recent NAEP assessments, students have been provided calcu- 
lators to gather information on certain blocks of items measuring 
ability to use calculators in mathematical situations. However, some 
items require students to demonstrate computation or estimation 
skills without the use of a calculator. 

In the 1996, 2000, and 2003 assessments, calculators were pro- 
vided on about one-third of the assessment. Students do not have 
access to a calculator on the about two-thirds of the exam. At grade 
4, NAEP provides students with a four-function calculator. At grades 
8 and 12, students are provided with a scientific calculator by NAEP. 

Manipulatives 

Starting with the 1990 assessment, students were provided rulers 
and protractors for use on some tasks on the assessments. With the 
1992 assessment, students received some geometric shapes to use 
in responding to items requiring the analysis of relationships be- 
tween these shapes and more complex shapes that could be formed 
from the pieces. Assessments in 1996, 2000, and 2003 expanded 
this practice, especially in settings in which students are given ex- 
tended time to work with materials that can be easily included in 
such a large-scale assessment. 
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Chapter Three 



NAEP Mathematics Objectives: 
Content Areas and Assessment Strands 

T o conduct a meaningful assessment of mathematics proficien- 
cy, it is necessary to measure students’ proficiencies in vari- 
ous content strands. As in the 1990 and 1992 assessments, 
five content strands will be used to categorize content for the mathe- 
matics assessments. The strands are illustrated later in this chapter. 
Classification of topics into these strands cannot be exact and 
inevitably will involve some overlap. For example, some topics 
appearing under Data Analysis, Statistics, and Probability may be 
closely related to others that appear under Algebra and Functions. 
As assessment programs continue to be refined, it becomes less de- 
sirable to force every item into only one content strand. Students are 
expected to solve problems that naturally involve more than one spe- 
cific mathematical topic. Consequently, the assessment as a whole 
will address the topics and subtopics identified in this chapter, and 
every item will be categorized under primarily one topic and sub- 
topic so that analysis of results may be somewhat specific. Ideally, 
however, the items will require students to synthesize knowledge 
across topics and subtopics, and occasionally it may be difficult to 
identify a unique topic for each item. In fact, at least half of the new 
items for the assessment should involve content from more than one 
topic or even from more than one strand. 

The following sections of this chapter provide a brief description 
of each content strand with a list of topics and subtopics to be in- 
cluded in the assessment. This level of specificity is needed to guide 
item writers and ensure adequate coverage of the content areas and 
abilities to be assessed. The five content strands for 1996, 2000, 
and 2003 are largely consistent with the strands used in the 1990 
and 1992 assessments. 

For each grade (4, 8, and 12), the following symbols are used: a 
“O” indicates that the subtopic can be assessed at that grade level, a 
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“A” indicates that the subtopic should not be assessed at that grade 
level, and a indicates that the subtopic may be introduced at a 
simple level, probably using a manipulative or pictorial model. The 
test specifications include additional detail and descriptions of how 
item types, families, calculators, manipulatives, and special studies 
fit within and across topics and subtopics. 



Number Sense, Properties, and Operations 

This strand focuses on students’ understanding of numbers (whole 
numbers, fractions, decimals, integers, real numbers, and complex 
numbers), operations, and estimation, and their application to real- 
world situations. Students are expected to demonstrate an under- 
standing of numerical relationships expressed in ratios, proportions, 
and percentages. Students are also expected to understand proper- 
ties of numbers and operations, generalize from numerical patterns, 
and verify results. 

Number sense includes items that address a student’s under- 
standing of relative size, equivalent forms of numbers, and his or 
her use of numbers to represent attributes of real-world objects and 
quantities. Items that call for students to complete open sentences 
involving basic number facts are considered part of this content 
strand. Items that require some application of the definition of 
operations and related procedures are classified under Algebra 
and Functions. 



The emphasis in computation is on understanding when to use 
an operation, knowing what the operation means, and being able to 
estimate and use mental techniques in addition to performing cal- 
culations using computational algorithms. In terms of actual com- 
putation, students are expected to demonstrate that they know how 
to perform basic algorithms and, in more complex situations, use cal- 
culators appropriately. Although some isolated computation items are 
included, a priority is placed on developing items in which mathe- 
matical operations are used in problem-solving situations. 



The grade 4 assessment emphasizes the development of number 
sense through the connection of various models to their numerical 
representations, as well as an understanding of the meaning of ad- 
dition, subtraction, multiplication, and division. JTJiese concepts are 
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addressed for whole numbers, simple fractions, and decimals at 
this grade level, emphasizing the use of models and their connec- 
tion to the use of symbols. 

The grade 8 assessment extends number sense to include both 
positive and negative numbers and addresses properties and opera- 
tions involving whole numbers, fractions, decimals, integers, and 
rational numbers. The use of ratios and proportional thinking to rep- 
resent situations involving quantity is a major focus at this grade 
level, and students are expected to read, use, and apply scientific 
notation to represent large and small numbers. 

At grade 12, the assessment includes both real and complex num- 
bers and tests students’ competency in topics up to and including 
precalculus. Operations with powers and roots, as well as various 
real and complex numbers, may be assessed. Including a broad 
range of items at this level ensures that students who have had dif- 
ferent types of high school mathematics courses will be able to 
demonstrate proficiency in some parts of this content area. 



NAEP Mathematics Content Strand 1 



Number Sense, Properties, and Operations 



Grade 
8 12 



1. Relate counting, grouping, and place value 

a. Use place value to model and describe whole numbers 

and decimals ® ® 

b. Use scientific notation in meaningful contexts A ® 

2. Represent numbers and operations in a variety of equivalent 
forms using models, diagrams, and symbols 

a. Model numbers using set models such as counters ® A 

b. Model numbers using number lines ® 

c. Use two- and three-dimensional region models to 

describe numbers # ® 






A 

A 

® 
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# Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 

O 
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Number Sense, Properties, and Operations 



Grade 

4 8 12 



d. Use other models appropriate to a given situation 

(for example, draw diagrams to represent a number or 
an operation; write a number sentence to fit a situation 
or describe a situation to fit a number sentence; interpret 
calculator or computer displays) • • 

e. Read, write, rename, order, and compare numbers • • 

.3. Compute with numbers (that is, add, subtract, multiply, 

divide) • • 

a. Apply basic properties of operations • • 

b. Describe effect of operations on size and order of numbers • • 

c. Describe features of algorithms (such as regrouping with 

or without manipulatives, partial products) • • 

d. Select appropriate computation method (such as pencil 

and paper, calculator, mental arithmetic) • • 



4. Use computation and estimation in applications • 

a. Round whole numbers, decimals, and fractions in 

meaningful contexts • 

b. Make estimates appropriate to a given situation 

i. Know when to estimate • 

ii. Select appropriate type of estimate (overestimate, 

' underestimate, range of estimate) • 

iii. Describe order of magnitude (estimation related to 

place value, scientific notation) • 

c. Select appropriate method of estimation (such as front 

end, rounding) • 

d. Solve application problems involving answers or estimates 

as appropriate • 

e. Interpret round-off errors using calculators/computers 

(that is, truncating) A 

f. Verify solutions and determine the reasonableness 
of results 

i. In real-world situations • 

ii. In abstract settings A 



# 



A 



• Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Number Sense, Properties, and Operations 



Grade 

4 8 12 



5. Apply ratios and proportional thinking in a variety 
of situations 



a. Use ratios to describe situations 


# 


• 




b. Use proportions to model problems 


A 


• 




c. Use proportional thinking to solve problems (including 
rates, scaling, and similarity) 


A 


• 




d. Understand the meaning of percentage (including 
percentages greater than 100 and less than 1) 


# 


• 




e. Solve problems involving percentages 


A 


• 




6. Use elementary number theory 

a. Describe odd and even numbers and their characteristics 


• 


• 




b. Describe number patterns 


# 


• 




c. Use factors and multiples to model and solve problems 


A 


• 




d. Describe prime numbers 


A 


• 


• 


e. Use divisibility and remainders in problem settings 
(including simple modular arithmetic) 


A 


# 


• 



• Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Measurement 

This strand focuses on an understanding of measurement and the 
use of numbers and measures to describe and compare mathemati- 
cal and real-world objects. Students are asked to identify attributes, 
select appropriate units and tools, apply measurement concepts, 
and communicate measurement-related ideas. 

Students should understand and be able to use the measurement 
attributes of length, mass/weight, capacity, time, money, and tem- 
perature. Students demonstrate their ability to extend basic concepts 
in applications involving, for example, perimeter, area, surface area, 
volume, and angle measure. 
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Students use measuring instruments and apply measurement 
concepts to solve problems. Due to the inherent imprecision of 
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measurement tools, it is important for students to recognize that 
measurement is an approximation. 

When students use technology for calculations with imprecise 
measurements, errors are often carried or increased. Students should 
be assessed on their judgments about such answers. 

The assessment focus at grade 4 is on time, money, temperature, 
length, perimeter, area, capacity, weight/mass, and angle measure. 
Although assessment at grades 8 and 12 continues to include these 
measurement concepts, the focus shifts to more complex measure- 
ment problems that involve volume or surface area or that require 
students to combine shapes, translate, and apply measures. Students 
in grades 8 and 12 should also solve problems involving proportion- 
al thinking (such as scale drawing or map reading) and do applica- 
tions that involve the use of complex measurement formulas. When 
appropriate and possible, measurement is assessed with real meas- 
uring devices. 

Items requiring straightforward computation with measures, espe- 
cially those involving time and money, are included not in this 
content strand but in Number Sense, Properties, and Operations. 

Applications involving measurement are a rich source of ques- 
tions that assess the connections among number sense and opera- 
tions, algebra, and geometry. 

NAEP Mathematics Content Strand 2 

r 



Grade 

Measurement 4 8 12 



1. Estimate the size of an object or compare objects with respect 

to a given attribute (such as length, area, capacity, volume, 
weight/mass) # # • 

2. Select and use appropriate measurement instruments (for 

example, manipulatives such as ruler, meter stick, protractor, 
thermometer, scales for weight or mass, gauges) ® @ ® 






® Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Measurement 



Grade 

4 8 12 



3. Select and use appropriate units of measurement according to: 

a. Type of unit • • • 

b. Size of unit • • • 



4. Estimate, calculate (using basic principles or formulas), 
or compare perimeter, area, volume, and surface area in 
meaningful contexts to solve mathematical and real-world 
problems 

a. Solve problems involving perimeter and area (such as 
triangles, quadrilaterals, other polygons, circles, combined 

forms) [Note: Grade 4 tasks use manipulatives] # • • 

b. Solve problems involving volume and surface area 
(such as rectangular solids, cylinders, cones, pyramids, 
prisms, combined forms) 

[Note: Grades 4 and 8 use manipulatives] # # • 

5. Apply given measurement formulas for perimeter, area, 

volume, and surface area in problem settings A ® ® 



6. Convert from one measurement to another within the same 
system (customary or metric) 



A • ® 



7. Determine precision, accuracy, and error 

a. Apply significant digits in meaningful contexts 

b. Determine appropriate size of unit of measurement in 
problem situations 

c. Apply concepts of accuracy of measurement in 
problem situations 

d. Apply absolute and relative error in problem situations 



A • • 

A • • 

A # • 

A A • 



8. Make and read scale drawings 



A • • 



9. Select appropriate methods of measurement (such as direct 
or indirect) 



• # ® 



10. Apply the concept of rate to measurement situations 



A © ® 



© Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 
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Geometry and Spatial Sense 

Spatial sense must be an integral component of the study and as- 
sessment of geometry. Understanding spatial relationships allows 
students to use the dynamic nature of geometry to connect mathe- 
matics to their world. 

This content strand extends well beyond low-level identification 
of geometric shapes into transformations and combinations of those 
shapes. Informal constructions and demonstrations (including draw- 
ing representations), along with their justifications, take precedence 
over more traditional types of compass-and-straightedge construc- 
tions and proofs. Although reasoning is addressed throughout the 
content areas, this strand addresses reasoning in formal and infor- 
mal settings. The extension of proportional thinking to similar fig- 
ures and indirect measurement is an important aspect of this strand. 

In grade 4, students are expected to model properties of shapes 
under simple combinations and transformations and use mathemat- 
ical communication skills to draw figures given a verbal descrip- 
tion. In grade 8, students are expected to understand properties of 
angles and polygons and apply reasoning skills to make and vali- 
date conjectures about transformations and combinations of shapes. 
In grade 12, students are expected to demonstrate proficiency with 
transformational geometry and to apply concepts of proportional 
thinking to various geometric situations. They also have opportuni- 
ties to demonstrate more sophisticated reasoning processes, and 
they are also expected to demonstrate various algebraic and geo- 
metric connections. The importance of these connections and their 
use in solving problems is indicated by the shifting emphasis in 
geometry to coordinate geometry, as described in chapter four. 



NAEP Mathematics Content Strand 3 



Grade 



Geometry and Spatial Sense 


4 


8 


12 


1 . Describe, visualize, draw, and construct geometric figures 

a. Draw or sketch a figure given a verbal description 
(open-ended items) 


• 


• 


• 


b. Given a figure, write a verbal description of its geometric 
qualities 


A 


• 


• 


2. Investigate and predict results of combining, subdividing, 
and changing shapes (such as paper folding, dissecting, 
tiling, rearranging pieces of solids) 


• 


• 


• 


3. Identify the relationship (congruence, similarity) between a 
figure and its image under a transformation 

a. Use motion geometry (informal: lines of symmetry, flips, 
turns, slides) 


• 


• 


• 


b. Use transformations (translations, rotations, reflections, 
dilations, symmetry) 

i. Synthetic 


A 


# 




ii. Algebraic 


A 


A 


• 


4. Describe the intersection of two or more geometric figures 
a. Two dimensional 


A 


• 


• 


b. Planar cross-section of a solid 


A 


• 


• 


5. Classify figures in terms of congruence and similarity, and 
informally apply these relationships using proportional 
reasoning where appropriate 


A 


# 


# 


6. Apply geometric properties and relationships in solving 
problems 

a. Use concepts of “between,” “inside,” “on,” and “outside” 


% 


• 


A 


b. Use the Pythagorean relationship to solve problems 


A 


• 


® 


c. Apply properties of ratio and proportion with respect 
to similarity 


A 


# 


• 


d. Solve problems involving right triangle trigonometric 
applications 


A 


A 


@ 



9 Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Geometry and Spatial Sense 



Grade 

4 8 12 



7. Establish and explain relationships involving geometric 
concepts 

a. Make conjectures 

b. Validate and justify conclusions and generalizations 

c. Use informal induction and deduction 



# • 



8. Represent problem situations with geometric models and 
apply properties of figures in meaningful contexts to solve 
mathematical and real-world problems 

9. Represent geometric figures and properties algebraically 
using coordinates and vectors 

a. Use properties of lines (including distance, midpoint, 



slope, parallelism, perpendicularity) to describe 



figures algebraically 


A 


# 


• 


b. Algebraically describe conic sections and their properties 


A 


A 


• 


c. Use vectors in problem situations (addition, subtraction, 








scalar multiplication, dot product) 


A 


A 


• 



• Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Data Analysis, Statistics, and Probability 

Because of its fundamental role in making sense of the world, this 
content strand receives increased emphasis. The important skills of 
collecting, organizing, reading, representing, and interpreting data 
are assessed in various contexts to reflect the pervasive use of these 
skills in dealing with information. Statistics and statistical concepts 
extend these basic skills to include analyzing and interpreting in- 
creasingly sophisticated data. Dealing with uncertainty and making 
predictions about outcomes require an understanding of not only the 
meaning of basic probability concepts but also the application of 
those concepts in problem-solving and decisionmaking situations. 
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Questions emphasize appropriate methods of gathering data, the 
visual exploration of data, ways to represent data, and the develop- 
ment and evaluation of arguments based on data analysis. Students 
are expected to apply these ideas in increasingly sophisticated situ- 
ations that require increasingly comprehensive analysis and deci- 
sionmaking. 

In grade 4, students are expected to apply their understanding of 
number and quantity by solving problems involving data and to use 
data analysis to broaden their number sense. They are expected to 
be familiar with various graphs. They are asked to make predictions 
from data and explain their reasoning and to deal informally with 
measures of central tendency. Grade 4 students also are asked to 
use the basic concept of chance in meaningful contexts not involv- 
ing the computation of probabilities. 

Probabilistic thinking and various specialized graphs become 
increasingly important in grades 8 and 12. Students in grade 8 are 
expected to analyze statistical claims and design experiments, and 
they may use simulations to model real-world situations. They should 
have some understanding of sampling, and they should be asked to 
make predictions based on experiments or data. They will begin to 
use some formal terminology related to probability, data analysis, 
and statistics. By grade 8, students should be comfortable using vari- 
ous graphs to represent different types of data in different situations. 

Students in grade 12 are expected to use a variety of statistical 
techniques to model situations and solve problems. Students at this 
level should apply concepts of probability to explore dependent 
and independent events, and they should be somewhat knowledge- 
able about conditional probability. They should be able to use for- 
mulas and more formal terminology to describe various situations. 
At this level, students should have a basic understanding of the use 
of mathematical equations and graphs to interpret data, including 
the use of curve fitting to match a set of data with an appropriate 
mathematical model. 
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NAEP Mathematics Content Strand 4 



Grade 



Data Analysis, Statistics, and Probability 


4 


8 


12 


1. Read, interpret, and make predictions using tables and graphs 
a. Read and interpret data 


• 


• 


• 


b. Solve problems by estimating and computing with data 


• 


• 


• 


c. Interpolate or extrapolate from data 


A 


• 


• 


2. Organize and display data and make inferences 

a. Use tables, histograms (bar graphs), pictograms, and 
line graphs 


• 


• 


• 


b. Use circle graphs and scattergrams 


A 


• 


• 


c. Use stem-and-leaf plots and box-and-whisker plots 


A 


• 


• 


d. Make decisions about outliers 


A 


• 


• 


3. Understand and apply sampling, randomness, and bias in 
data collection 

a. Given a situation, identify sources of sampling error 


A 


• 


• 


b. Describe a procedure for selecting an unbiased sample 


A 


• 


• 


c. Make generalizations based on sample results 


A 


• 


• 


4. Describe measures of central tendency and dispersion in 
real-world situations 


# 


• 




5. Use measures of central tendency, correlation, dispersion, 
and shapes of distributions to describe statistical relationships 

a. Use standard deviation and variance 


A 


A 




b. Use the standard normal distribution 


A 


A 




c. Make predictions and decisions involving correlation 


A 


A 


• 


6. Understand and reason about the use and misuse of statistics 
in our society 

a. Given certain situations and reported results, identify 
faulty arguments or misleading presentations of the data 


# 




# 


b. Appropriately apply statistics to real-world situations 


# 


• 




7. Fit a line or curve to a set of data and use this line or 
curve to make predictions about the data, using frequency 
distributions where appropriate 


A 


A 


• 





& Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Grade 



Data Analysis, Statistics, and Probability 


4 


8 


12 


8. Design a statistical experiment to study a problem and 


communicate the outcomes 


A 


• 


• 


9. Use basic concepts, trees, and formulas for combinations, 
permutations, and other counting techniques to determine 
the number of ways an event can occur 


A 


• 


• 


10. Determine the probability of a simple event 


a. Estimate probabilities by use of simulations 


A 


• 


• 


b. Use sample spaces and the definition of probability to 
describe events 


• 


• 


• 


c. Describe and make predictions about expected outcomes 


A 


• 


• 


1 1 . Apply the basic concept of probability to real-world situations 


a. Use probabilistic thinking informally 


• 


• 


• 


b. Use probability related to independent and dependent 
events 


A 


• 


• 


c. Use probability related to simple and compound events 


A 


A 


• 


d. Use conditional probability 


A 


A 


• 



• Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Algebra and Functions 

This strand extends from work with simple patterns at grade 4 
to basic algebra concepts at grade 8 and sophisticated analysis at 
grade 12; it involves not only algebra but also precalculus and some 
topics from discrete mathematics. Algebraic concepts are developed 
throughout the grades, emphasizing informal modeling at the ele- 
mentary level and functions at the secondary level. Students are 
expected to use algebraic notation and thinking in meaningful con- 
texts to solve mathematical and real-world problems, specifically 
addressing an increasing understanding of the use of functions 
(including algebraic and geometric) as a representational tool. 

The assessment at all levels includes the use of open sentences 
and equations as representational tools. Students are expected to 
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use equivalent representations to transform and solve number 
sentences and equations of increasing levels of complexity. 

The grade 4 assessment involves the informal demonstration of 
students’ abilities to generalize from patterns and justify their gen- 
eralizations. Students are expected to translate mathematical repre- 
sentations, use simple equations, and demonstrate basic graphing. 

The grade 8 assessment includes more algebraic notation, stress- 
ing the meaning of variables and an informal understanding of the 
use of symbolic representations in problem-solving contexts. Stu- 
dents at this level are asked to use variables to represent a rule un- 
derlying a pattern. They should have a beginning understanding of 
equations as a modeling tool, and they should solve simple equa- 
tions and inequalities through various methods, including both 
graphical and basic algebraic methods. Students should begin to 
use basic concepts of functions to describe relationships. 

In grade 12, students are expected to be adept at appropriately 
choosing and applying a rich set of representational tools in vari- 
ous problem-solving situations. They should have an understand- 
ing of basic algebraic notation and terminology as they relate to 
representations of mathematical and real-world problem situations. 
Students should be able to use functions to represent and describe 
relationships. 

NAEP Mathematics Content Strand 5 



Algebra and Functions 



Grade 

4 8 12 



1. Describe, extend, interpolate, transform, and create a wide 
variety of patterns and functional relationships 

a. Recognize patterns and sequences 

b. Extend a pattern or functional relationship 

c. Given a verbal description, extend or interpolate with a 
pattern (complete a missing term) 



• • • 

• • ® 

A • • 




® Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 
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Algebra and Functions 



Grade 

4 8 12 



d. Translate patterns from one context to another 

e. Create an example of a pattern or functional relationship 

f. Understand and apply the concept of a variable 




2 . 



Use multiple representations for situations to translate 

among diagrams, models, and symbolic expressions • • • 



3. Use number lines and rectangular coordinate systems as 
representational tools 

a. Identify or graph sets of points on a number line or 
in a rectangular coordinate system 

b. Identify or graph sets of points in a polar coordinate 
system 

c. Work with applications using coordinates 

d. Transform the graph of a function 



A A • 

A • • 

A # • 



4. Represent and describe solutions to linear equations and 
inequalities to solve mathematical and real-world problems 

a. Provide solution sets of whole numbers • • • 

b. Provide solution sets of real numbers # • • 



5. Interpret contextual situations and perform algebraic 
operations on real numbers and algebraic expressions to 
solve mathematical and real-world problems 

a. Perform basic operations, using appropriate tools, on real 
numbers in meaningful contexts (including grouping and 
order of multiple operations involving basic operations, 
exponents, and roots) 

b. Solve problems involving substitution in expressions 
and formulas 

c. Solve meaningful problems involving a formula with 
one variable 

d. Use equivalent forms to solve problems 



A • # 

A • • 

A • • 

A • • 



6. Solve systems of equations and inequalities using 
appropriate methods 

a. Solve systems graphically 

b. Solve systems algebraically 

c. Solve systems using matrices 



A • • 
A A ® 
A A • 



® Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 



Grade 



Algebra and Functions 


4 


8 


12 


7. Use mathematical reasoning 


a. Make conjectures 


• 


• 


• 


b. Validate and justify conclusions and generalizations 


• 


• 


• 


c. Use informal induction and deduction 


# 


• 


• 


8. Represent problem situations with discrete structures 


a. Use finite graphs and matrices 


A 


# 


• 


b. Use sequences and series 


A 


A 


• 


c. Use recursive relations (including numerical and 
graphical iteration and finite differences) 


A 


A 


• 


9. Solve polynomial equations with real and complex roots 
using a variety of algebraic and graphical methods and 
using appropriate tools 


A 


A 


• 


10. Approximate solutions of equations (bisection, sign 


changes, and successive approximations) 


A 


# 


• 


1 1 . Use appropriate notation and terminology to describe 
functions and their properties (including domain, range, 
function composition, and inverses) 


A 


A 


• 


12. Compare and apply the numerical, symbolic, and 

graphical properties of a variety of functions and families 
of functions, examining general parameters and their 
effect on curve shape 


A 


# 


• 


13. Apply function concepts to model and deal with real-world 


situations 


A 


# 


• 


14. Use trigonometry 


a. Use triangle trigonometry to model problem situations 


A 


A 


• 


b. Use trigonometric and circular functions to model 
real-world phenomena 


A 


A 


• 


c. Apply concepts of trigonometry to solve real-world 
problems 


A 


A 


• 



# Subtopic can be assessed at this grade level. 

A Subtopic should not be assessed at this grade level. 

# Subtopic may be introduced at a simple level 
(such as using a manipulative or pictorial model). 
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Chapter Four 

Cognitive Abilities 



A lthough NAEP was designed to monitor, assess, and report 
student achievement nationally, an inevitable effect of this 
monitoring and reporting is improvement in mathematics 
learning. If real change in the mathematics curriculum is to take 
place, the manner in which assessment is conducted will also have 
to change. Assessment activities often are the primary sources from 
which students discern what teachers really value and what teach- 
ers really want them to know. 

Mathematical Power 

Mathematical power is characterized as a student’s overall ability 
to gather and use mathematical knowledge through exploring, con- 
jecturing, and reasoning logically; solving nonroutine problems; 
communicating about and through mathematics; and connecting 
mathematical ideas in one context with mathematical ideas in an- 
other context or with ideas from another discipline in the same or 
related contexts. 

Assessing a student’s mathematical power requires many different 
indicators over time. As power develops beyond the general mathe- 
matical abilities of conceptual understanding, procedural knowledge, 
and problem solving, it is important to ensure that students are as- 
sessed on their ability to reason in mathematical situations, com- 
municate perceptions and conclusions drawn from a mathematical 
context, and connect the mathematical nature of a situation with re- 
lated mathematical knowledge and information gained from other 
disciplines or through observation. 

It is the total interaction of all of these abilities that defines a 
student’s overall mathematical power at a given time. The mental 
skills of reasoning, communicating, and connecting are the founda- 
tion of each content strand and each mathematical ability featured 
in previous NAEP assessments. These relationships, discussed in 



chapter two, indicate the multidimensional nature of mathematical 
power. 

Mathematical power can be viewed from various perspectives. 
Students may encounter a new problem in an old context or an old 
problem in a new context. When first attempts to solve a problem 
fail, the student may reexamine the information, rework it, and then 
reapply it to the situation in a more productive fashion. The process 
of revising an approach to a problem based on reasoning, gathering 
new information, and making connections with other ideas is a dy- 
namic ability. This feature of mathematical power can be viewed 
through student performance within a particular content strand at 
the conceptual, procedural, and problem-solving levels of ability. 
Similarly, a particular concept, procedure, or problem context might 
be viewed across strands. In the latter case, families of items are 
particularly helpful in assessment. The use of calculators enables 
students to quickly pursue alternative paths and determine whether 
they provide fruitful new information or reconfirm judgments made 
through other approaches. 

Students demonstrate their mathematical power by formulating 
problem-solving and reasoning strategies in situations involving a 
multitude of possibilities. It is here that the recommendation that 
students experience a number of extended open-ended items requir- 
ing construction of responses is important. Through a student’s 
report of his or her thinking, questions of the relevance of the ap- 
proach, the nature of reasoning, and the ability to solve problems 
become less inferential and more conclusively based on evidence. 
This is especially true when the collected evidence includes the 
communication of a student’s approach and when partial credit 
for student efforts is awarded in the scoring of an item. 

Finally, mathematical power is a function of students’ prior 
knowledge and experience and the ability to connect that knowl- 
edge in productive ways to new contexts. This aspect of power 
can be measured with multiple-choice items and through analysis 
of the ways in which students develop their responses to the con- 
structed-response items on the assessment. 

Information related to these features of students’ development 
is as difficult to isolate apd statistically extract from the data as the 
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mathematical abilities featured in the past NAEP assessments in 
mathematics. However, they are important aspects of the mathemat- 
ical development of students. As such, the three features of mathe- 
matical power (reasoning, communication, and connections) will 
be used as underlying threads for item construction and overall test 
design. For the mathematics assessment, these threads may not be 
specifically reported, although they will be represented in the over- 
all way the assessment is conceived and developed. 

Mathematical Abilities 

As previously discussed, the general mental abilities associated 
with mathematics and targeted in past NAEP assessments are con- 
ceptual understanding, procedural knowledge, and problem solving. 
These three areas are specifically identified as primary foci for as- 
sessment, and they received focal attention in the design of the 1990 
and 1992 assessments. Conceptual understanding can be viewed 
simply as a measure of a student’s “knowing that” or “knowing 
about,” whereas procedural knowledge can be viewed as a student’s 
“knowing how.” These two abilities are the foundation for recog- 
nizing and understanding a problem, formulating a plan to solve 
the problem, arriving at a solution to the problem, and reflecting 
on the solution. The later stages can be thought of as facets of 
problem solving. 

However, as recommended in chapter one, the role of these di- 
mensions of students’ mathematical power in the new assessment 
should change from one of a direct matrix feature to one of a de- 
sign characteristic that assists in providing balance to the overall 
assessment. The NAEP design for the mathematics assessment 
should certainly continue to focus on conceptual understanding, 
procedural knowledge, and problem solving in bringing some bal- 
ance to the assessments for grades 4, 8, and 12. In particular, it is 
recommended that at least one-third of the items for each grade 
level measure conceptual understanding, procedural knowledge, 
and problem solving. 

As with the mathematical content strands, mathematical abili- 
ties are not separate and distinct factors of an individual’s ways of 
thinking about a mathematical situation. These abilities are, rather, 



descriptions of the ways in which information is structured for in- 
struction and the ways in which students manipulate, reason with, 
or communicate their mathematical ideas. Consequently, no unani- 
mous agreement exists among educators about what constitutes a 
conceptual, a procedural, or a problem-solving item. What can be 
classified are the actions a student is likely to undertake in process- 
ing information and providing a satisfactory response. Thus, within 
the content strands, assessment tasks are classified according to the 
ability categories they most closely represent in terms of the type 
of processing they are expected to require. Furthermore, the mathe- 
matical power features of reasoning, communication, and connec- 
tions are woven through the specifications to provide an added 
level of richness to the assessment tasks. 

The following discussions of conceptual understanding, proce- 
dural knowledge, and problem solving illustrate the primary fea- 
tures the NAEP assessment should employ to capture features of 
cognitive activities that combine to empower a student in mathe- 
matical situations. 

Conceptual Understanding 

Students demonstrate conceptual understanding in mathematics 
when they provide evidence that they can recognize, label, and gen- 
erate examples and nonexamples of concepts; use and interrelate 
models, diagrams, manipulatives, and varied representations of con- 
cepts; identify and apply principles (that is, valid statements gener- 
alizing relationships among concepts in conditional form); know 
and apply facts and definitions; compare, contrast, and integrate re- 
lated concepts and principles to extend the nature of concepts and 
principles; recognize, interpret, and apply the signs, symbols, and 
terms used to represent concepts; or interpret the assumptions and 
relations involving concepts in mathematical settings. 

Conceptual understanding reflects a student’s ability to reason 
in settings involving the careful application of concept definitions, 
relations, or representations of either. Students demonstrate con- 
ceptual understanding when they produce examples or common 
or unique representations, or when they manipulate central ideas 
about a concept in various ways. 
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Procedural Knowledge 

Students demonstrate procedural knowledge in mathematics 
when they select and apply appropriate procedures correctly; veri- 
fy or justify the correctness of a procedure using concrete models 
or symbolic methods; or extend or modify procedures to deal with 
factors inherent in problem settings. 

Procedural knowledge includes the various numerical algorithms 
in mathematics that have been created as tools to meet specific needs 
efficiently. Procedural knowledge also encompasses the abilities to 
read and produce graphs and tables, execute geometric construc- 
tions, and perform noncomputational skills such as rounding and 
ordering. These latter activities can be differentiated from concep- 
tual understanding by the task context or presumed student back- 
ground — that is, an assumption that the student has the conceptual 
understanding of a representation and can apply it as a tool to cre- 
ate a product or to achieve a numerical result. In these settings, the 
assessment question is how well the student executed a procedure 
or selected the appropriate procedure to perform a given task. 

Procedural knowledge is often reflected in a student’s ability to 
connect an algorithmic process with a given problem situation, em- 
ploy that algorithm correctly, and communicate the results of the 
algorithm in the context of the problem setting. Procedural under- 
standing also encompasses a student’s ability to reason through a 
situation, describing why a particular procedure will solve a prob- 
lem in the context described. 

Problem Solving 

In problem solving, students are required to use their accumulat- 
ed knowledge of mathematics in new situations. Problem solving 
requires students to recognize and formulate problems; determine 
the sufficiency and consistency of data; use strategies, data, models, 
and relevant mathematics; generate, extend, and modify procedures; 
use reasoning (spatial, inductive, deductive, statistical, or proportion- 
al) in new settings; and judge the reasonableness and correctness of 
solutions. Problem-solving situations require students to connect all 
of their mathematical knowledge of concepts, procedures, reasoning, 
and communication/representational skills in confronting new situ- 
ations. As such, these situations are perhaps the most accurate meas- 
ures of students’ proficiency in mathematics. 
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Chapter Five 



Item Types 

C entral to the development of the NAEP assessment in mathe- 
matics is the careful selection of test questions or items to 
measure the content objectives and cognitive areas. The 
NAEP mathematics assessment consists of multiple-choice, short 
constructed-response, and extended constructed-response items. Ex- 
amples of NAEP mathematics items for grades 4, 8, and 12 are pro- 
vided below. Please refer to the NAEP Web site at www.nces.ed.gov/ 
nationsreportcard for additional items, scoring rubrics, perform- 
ance data, and sample student responses. 



Multiple-Choice Items 
Grade 4 



503-207 = 

A. 206 
*B. 296 

C. 304 

D. 396 

[Percent correct: 53 %] 



N stands for the number of stamps John had. He gave 12 
stamps to his sister. Which expression tells how many stamps 
John has now? 



A. N+ 12 
*B. N— 12 

C. 12 -N 

D. 12 x N 

[Percent correct: 67 %] 



In a bag of marbles, 1/2 are red, 1/4 are blue, 1/6 are green, 
and 1/12 are yellow. If a marble is taken from the bag without 
looking, it is most likely to be 

*A. red 

B. blue 

C. green 

D. yellow 

[Percent correct: 25 %] 
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Grade 8 



2 _ n 

K 25 500 ’ thenn = 

A. 10 

B. 20 

C. 30 
*D. 40 

E. 50 

[Percent correct: 48 %] 



Which of the following ordered pairs ( x , y) is a solution to 
the equation 2x - 3y = 6? 

A. (6,3) 

*B. (3,0) 

C. (3,2) 

D. (2,3) 

E. (0,3) 

[Percent correct: 41 %] 



How many hours are equal to 150 minutes? 

A. Yk 

B. 2 ‘A 

C. 27 3 
*D. 2'k 

E. 2 5 A 

[Percent correct: 58 %] 

(Note: Fractions appeared with horizontal fraction bars on the exam.) 
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Grade 12 




Volume = w Volume = x Volume = y 



In the figures above, the radius and height of each right circu- 
lar cylinder are given. If w, x, and y represent the volume of 
the cylinders, which of the following statements is true? 

A. y = w = X 
*B. y<x<w 

C. y < w < x 

D. w < y < x 

E. w < x < y 

[Percent correct: 30 %] 
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Grade 12 
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Grade 12 




The length of a side of the square above is 6. What is the 
length of the radius of the circle? 

A. 2 
*B. 3 

C. 4 

D. 6 

E. 8 

[Percent corrects 70% ] 



Short Constructed-Response Items 

To provide more reliable and valid opportunities for extrapolat- 
ing about students' approaches to problems, recent NAEP assess- 
ments have included items that are often referred to as constructed 
response or open ended. These short-answer items require students 
to give either a numerical result or the correct name or classifica- 
tion for a group of mathematical objects, draw an example of a 
given concept, or write a brief explanation for a given result. 

Grade 4 



Ms. Hernandez formed teams of 8 students each from the 34 
students in her class. She formed as many teams as possible, 
and the students left over were substitutes. 

How many students were substitutes? 

Answer: 
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Grade 4 



How many fourths make a whole? 
Answer: 

[Percent correct: 50 %] 



Scoring Guide 


Score and Description — 

Correct 

Correct Response 

4, or four fourths, or 4 fourths, etc. 


- 


Incorrect 




Incorrect response 
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Grade 8 



From any vertex of a 4-sided polygon, 1 diagonal can be drawn. 

From any vertex of a 5-sided polygon, 2 diagonals can be drawn. 

From any vertex of a 6-sided polygon, 3 diagonals can be drawn. 

From any vertex of a 7-sided polygon, 4 diagonals can be drawn. 

How many diagonals can be drawn from any vertex of a 20-sided 
polygon? 

Answer: 

[Percent correct: 54 %] 




In this question a student needed to demonstrate an understanding 
of diagonals of polygons. A diagonal of a polygon is a segment 
that joins two nonadjacent vertices (a vertex is a common endpoint 
of two sides of the polygon). To answer the question it was expect- 
ed that a student would observe that the number of diagonals from 
any vertex is 3 less than the number of sides. That is, from any ver- 
tex of a convex polygon a diagonal can be drawn to any of the other 
vertices of that polygon except the two adjacent vertices. For a 20- 
sided polygon, the answer is 20 - 3 = 17. 

Score and Description 

Correct 

Correct response (17) 

Incorrect 

Any incorrect response 
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Grade 8 



Hair Color Survey Results 



Color of Hair 


Percentage 


Blond 


17 


Brown 


50 


Black 


33 


Total 


100 



The table above shows the results of a survey of hair color. On the 
circle below, make a circle graph to illustrate the data in the table. 
Label each part of the circle graph with the correct hair color. 




[Percent correct: 72%] 



Grade 8 



Scoring Guide 
Score and Description 




Correct 

The brown region should be about '/ 2 of the circle. 

The blond region should be about '/ 2 the black region. 

All three regions must be labeled with the correct colors or 
with the correct percents. 

Incorrect 

Incorrect answer 
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Grade 12 




In the figure above, ABDG is a parallelogram and CDEF is a 
rectangle. 

If EF = 9 and CG =10, what is AB to the nearest hundredth? 

Answer: 

(Students had access to a calculator.) 

[Percent correct: 21 %] 

Scoring Guide 
Score and Description 
Correct 

13.45 

Solution: 

FE= CD = 9 

AB = DG =■ V 10 2 + 9 2 

=V 181 

= 13.45 

Incorrect #1 

Incorrect answer other than\/l81 

Incorrect #2 

Vl 81 
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Extended Constructed-Response Items 

Extended constructed-response items require students to consid- 
er a situation that demands more than a numerical or short verbal 
response. These items require the student to carefully consider a 
problem within or across the content strands, understand what is re- 
quired to “solve” the problem, choose a plan of attack, carry out 
the attack, and interpret the solution in terms of the original prob- 
lem. The response mode requires that students provide evidence of 
their work on some aspects of the problem-solving process and com- 
municate their decisionmaking steps in the context of the problem. 

Grade 4 

Think carefully about the following question. Write a complete 
answer. You may use drawings, words, and numbers to explain 
your answer. Be sure to show all of your work. 

There are 20 students in Mr. Pang’s class. On Tuesday, most of the 
students in the class said they had pockets in the clothes they were 
wearing. 
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Grade 4 
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Which of the graphs most likely shows the number of pockets that 
each child had? 

Explain why you chose that graph. 

Explain why you did not choose the other graphs. 

Scoring Guide 
Solution: 

Graph B because it had 20 students and most of the students had 
pockets. 

It could not be graph A because most of the students should have 
pockets. 



Grade 4 

It could not be graph C, since there are more than 20 students 
shown. 

OR 

It is not likely that there would be the same number of students for 
each number of pockets. 

OR _ 

Most clothes don’t have 10 pockets. 

Score and Description 
Extended 

The student chooses graph B and gives a good explanation 
why it should be B and explains why it can’t be A or C. The 
explanation must deal with both the number of students in the 
class and the fact that most of them have pockets. These expla- 
nations may occur in either response. 

Satisfactory 

The student chooses graph B and gives a good explanation 
(which includes the fact that graph B has 20 students and most 
of the students have pockets) but does not mention the other 
graphs. 

OR 

The student gives a good explanation why it cannot be A or C 
but does not give a good explanation of why it is B. (See exam- 
ples in solution above for explanations.) 
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Grade 4 



Partial 

The student chooses graph B but does not give an adequate, 
relevant explanation. 

OR 

The student chooses B but gives no explanation why; student 
explains why it’s not C or why it’s not A. 

Minimal 

The student chooses graph B with no explanation or a weak, 
nonrelevant (e.g., because it made sense) explanation. 

OR 

The student chooses A or C with an explanation that shows 
some understanding. 

Incorrect/Off Task 

The work is completely incorrect, irrelevant, or off task. 

OR 

The student answers A or C with no explanation. 



[Extended 3%, Satisfactory 7%, Partial 15%, Minimal 23%] 
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Grade 8 



This question requires you to show your work and explain your 
reasoning. You may use drawings, words, and numbers in your ex- 
planation. Your answer should be clear enough so that another per- 
son could read it and understand your thinking. It is important that 
you show all your work. 

Radio station KMAT in Math City is 200 miles from radio station 
KGEO in Geometry City. Highway 7, a straight road, connects the 
two cities. 






Radio 

Station 



KMAT broadcasts can be 

received up to 150 miles / , , — - _ % 

in all directions from the 
station and KGEO broad- 
casts can be received up 

to 125 miles in all direc- \ >* ^ ✓ 

tions. Radio waves travel 

from each radio station through the air, as represented above. 

On the next page, draw a diagram that shows the following: 
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Radio 

Wave 



• Highway 7. 

• The location of the two radio stations. 



• The part of Highway 7 where both radio stations can be received. 



Be sure to label the distances along the highway and the length in 
miles of the part of the highway where both stations can be received. 



Scoring Guide 
Solution: 

There is a 75-mile 
part of Highway 7 
that is within both 
broadcast areas. It 
starts 75 miles out- 
side Math City and 
ends 150 miles out- 
side Math City. 




stations can be 
received. 



Grade 8 



Score and Description 

Extended 

Correct answer. (75 miles must be stated.) 

Satisfactory 

Map with cities or stations and 200 miles labeled (or a clear 
and correct application of scale) and identifies common broad- 
cast area on Highway 7 but omits length of common area. 

Partial 

Map with cities or stations and 200 miles labeled (or some 
attempt at using a scale): the highway should be shown as 
straight, and identifies incorrect common broadcast area (e.g. 
not on Highway 7) or insufficiently identifies an area. (Insuffi- 
ciently means that there is not enough information labeled to 
determine the length of the common broadcast area.) Bounds 
of common area may or may not be labeled. 

Minimal 

Map with cities or stations and 200 miles labeled (or some attempt 
to use a scale). Highway should be shown as straight. There is no 
indication of how student determined common broadcast area. (It 
may, for example, be represented as a single point or not at all.) 

OR 

Map that uses some but not all of given information with no 
indication of how common broadcast area was determined. 

Incorrect/Off Task 

The work is completely incorrect, irrelevant, or off task. 

Note: 

A student’s map must include enough information concerning the 
lengths given in the question to justify that 75 miles is the com- 
mon broadcast area. If pertinent information concerning lengths is 
missing, the maximum score that can be awarded is Partial. 

[Extended 1%, Satisfactory 4%, Partial 13%, Minimal 22 %] 



Grade 12 



This question requires you to show your work and explain your 
reasoning. You may use drawings, words, and numbers in your 
explanation. You answer should be clear enough so that another 
person could read it and understand your thinking. It is important 
that you show all your work. 

The table below shows the daily attendance at two movie theaters 
for 5 days and the mean (average) and the median attendance. 





Theater A 


Theater B 


Day 1 


100 


72 


Day 2 


87 


97 


Day 3 


90 


70 


Day 4 


10 


71 


Day 5 


91 


100 


Mean (average) 


75.6 


82 


Median 


90 


72 



(a) Which statistic, the mean or the median, would you use to de- 
scribe the typical daily attendance for the 5 days at Theater A? 
Justify your answer. 

(b) Which statistic, the mean or the median, would you use to de- 
scribe the typical daily attendance for the 5 days at Theater B? 
Justify your answer. 

Scoring Guide 
Solution: 

Selects and provides appropriate explanation for why the mean is 
a better measure for the typical attendance for Theater B and the 
median is the better measure for Theater A. 

An explanation for Theater A should include the idea that the atten 
dance on day 4 is much different than the attendance numbers for 
any other days for Theater A. 



Grade 12 



An appropriate explanation for Theater B should include the 
following ideas: 

• There are two clusters of data. 

• The median is representative of only one of the clusters while 
the mean is representative of both. 

OR 

• a justification that conveys the idea that 82 is a better indicator 
of where the “center” of the 5 data points is located 

Scoring Guide 

In this question, a student has to look at the data and determine 
which measure, the median or the mean, would best describe the 
typical daily attendance at each theater. A student has to have an 
understanding of the meaning of mean and median in order to pro- 
vide a correct answer and explanation. For full credit, a student has 
to answer the median for part a and include an explanation that 
would include that day 4’s attendance is significantly different than 
the rest of the days and the mean for part b with an explanation 
that shows an understanding that the mean is a better indicator be- 
cause all of the attendance numbers for Theater B are clustered. 
Varying levels of partial credit (satisfactory, partial, and minimal) 
could be earned depending on how well the student reasons and 
communicates the correct answer. 
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Grade 12 



Score and Description 
Extended 

Indicates the better measure for each theater and gives a 
complete explanation for each measure. 

Satisfactory 

Indicates the better measure for each theater and gives a 
complete explanation for one measure. 

Partial 

Indicates mean for Theater B and median for Theater A with 
either no explanation or an incomplete explanation. 

OR 

The student selects the better measure for one theater and 
gives an appropriate explanation. 

Minimal 

Indicates the mean for Theater B with no explanation or an 
incomplete explanation. 

OR 

The student indicates the median for Theater A with no 
explanation or an incomplete explanation. 

Incorrect 

Incorrect response 



[Extended 1%, Satisfactory 3%, Partial 10%, Minimal 28 %] 
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Appendix A 



NAEP Mathematics Achievement 
Level Descriptions 



NAEP Mathematics Achievement 
Levels — Grade 4 

Basic Fourth-grade students performing at the Basic level 
should show some evidence of understanding the 
mathematical concepts and procedures in the five 
NAEP content strands. 

Fourth graders performing at the Basic level should be 
able to estimate and use basic facts to perform simple 
computations with whole numbers, show some under- 
standing of fractions and decimals, and solve some 
simple real-world problems in all NAEP content areas. 
Students at this level should be able to use — although 
not always accurately — four-function calculators, rulers, 
and geometric shapes. Their written responses are often 
minimal and presented without supporting information. 

Proficient Fourth-grade students performing at the Proficient 

level should consistently apply integrated procedural 
knowledge and conceptual understanding to problem 
solving in the five NAEP content strands. 

Fourth-graders performing at the Proficient level should 
be able to use whole numbers to estimate, compute, 
and determine whether results are reasonable. They 
should have a conceptual understanding of fractions 
and decimals; be able to solve real-world problems in 
all NAEP content areas; and use four-function calcula- 
tors, rulers, and geometric shapes appropriately. Stu- 
dents performing at the Proficient level should employ 
problem-solving strategies such as identifying and 
using appropriate information. Their written solutions 
should be organized and presented both with support- 
ing information and with explanations of how they 
were achieved. 




Advanced Fourth-grade students performing at the Advanced 
level should apply integrated procedural knowledge 
and conceptual understanding to complex and nonrou- 
tine real-world problem solving in the five NAEP con- 
tent strands. 

Fourth graders performing at the Advanced level 
should be able to solve complex nonroutine real-word 
problems in all NAEP content strands. They should 
display mastery in the use of four-function calculators, 
rulers, and geometric shapes. The students are expect- 
ed to draw logical conclusions and justify answers and 
solution processes by explaining why, as well as how, 
they were achieved. They should go beyond the obvi- 
ous in their interpretations and be able to communicate 
their thoughts clearly and concisely. 
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NAEP Mathematics Achievement 
Levels — Grade 8 



Basic Eighth-grade students performing at the Basic level 
should exhibit evidence of conceptual and procedural 
understanding in the five NAEP content strands. This 
level of performance signifies an understanding of arith- 
metic operations — including estimation — on whole 
numbers, decimals, fractions, and percents. 

Eighth graders performing at the Basic level should 
complete problems correctly with the help of structural 
prompts such as diagrams, charts, and graphs. They 
should be able to solve problems in all NAEP content 
strands through the appropriate selection and use of 
strategies and technological tools — including calcula- 
tors, computers, and geometric shapes. Students at this 
level also should be able to use fundamental algebraic 
and informal geometric concepts in problem solving. 

As they approach the proficient level, students at the 
Basic level should be able to determine which of the 
available data are necessary and sufficient for correct 
solutions and use them in problem solving. However, 
these eighth graders show limited skill in communicat- 
ing mathematically. 

Proficient Eighth-grade students performing at the Proficient 

level should apply mathematical concepts and proce- 
dures consistently to complex problems in the five 
NAEP content strands. 

Eighth graders performing at the Proficient level should 
be able to conjecture, defend their ideas, and give sup- 
porting examples. They should understand the connec- 
tions among fractions, percents, decimals, and other 
mathematical topics such as algebra and functions. 
Students at this level are expected to have a thorough 
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understanding of basic-level arithmetic operations — an 
understanding sufficient for problem solving in practi- 
cal situations. 

Quantity and spatial relationships in problem solving 
and reasoning should be familiar to them, and they 
should be able to convey underlying reasoning skills 
beyond the level of arithmetic. They should be able to 
compare and contrast mathematical ideas and generate 
their own examples. These students should make in- 
ferences from data and graphs, apply properties of 
informal geometry, and accurately use the tools of 
technology. Students at this level should understand 
the process of gathering and organizing data and be 
able to calculate, evaluate, and communicate results 
within the domain of statistics and probability. 



Advanced Eighth-grade students performing at the Advanced 



level should be able to reach beyond the recognition, 
identification, and application of mathematical rules to 
generalize and synthesize concepts and principles in 
the five NAEP content strands. 

Eighth graders performing at the Advanced level 
should be able to probe examples and counterexamples 
to shape generalizations from which they can develop 
models. 

Eighth graders performing at the Advanced level 
should use number sense and geometric awareness to 
consider the reasonableness of an answer. They are 
expected to use abstract thinking to create unique 
problem-solving techniques and explain the reasoning 
processes underlying their conclusions. 
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NAEP Mathematics Achievement 
Levels — Grade 12 



Basic 



Proficient 



Twelfth-grade students performing at the Basic level 
should demonstrate procedural and conceptual knowl- 
edge in solving problems in the five NAEP content 
strands. 

Twelfth-grade students performing at the Basic level 
should be able to use estimation to verify solutions and 
determine the reasonableness of results as applied to 
real-world problems. Twelfth graders performing at the 
Basic level should recognize relationships presented 
in verbal, algebraic, tabular, and graphical forms, and 
demonstrate knowledge of geometric relationships and 
corresponding measurement skills. 

They should be able to apply statistical reasoning in the 
organization and display of data and in reading tables 
and graphs. They should also be able to generalize from 
patterns and examples in the areas of algebra, geome- 
try, and statistics. At this level, they should use correct 
mathematical language and symbols to communicate 
mathematical relationships and reasoning processes 
and use calculators appropriately to solve problems. 

Twelfth-grade students performing at the Proficient 
level should consistently integrate mathematical con- 
cepts and procedures into the solutions of more com- 
plex problems in the five NAEP content strands. 

Twelfth graders performing at the Proficient level should 
demonstrate an understanding of algebraic, statistical, 
geometric, and spatial reasoning. They should be able 
to perform algebraic operations involving polynomials, 
justify geometric relationships, and judge and defend 
the reasonableness of answers as applied to real-world 
situations. These students should be able to analyze and 



interpret data in tabular and graphical form; understand 
and use elements of the function concept in symbolic, 
graphical, and tabular form; and make conjectures, 
defend ideas, and give supporting examples. 

Advanced Twelfth-grade students performing at the Advanced level 
should consistently demonstrate the integration of pro- 
cedural and conceptual knowledge and the synthesis of 
ideas in the five NAEP content strands. 

Twelfth-grade students performing at the Advanced level 
should understand the function concept and be able to 
compare and apply the numeric, algebraic, and graphi- 
cal properties of functions. They should apply their 
knowledge of algebra, geometry, and statistics to solve 
problems in more advanced areas of continuous and 
discrete mathematics. 

They should be able to formulate generalizations and 
create models through probing examples and counter- 
examples. They should be able to communicate their 
mathematical reasoning through the clear, concise, and 
correct use of mathematical symbolism and logical 
thinking. 
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NAEP Mathematics Project Staff and 
Committees 



NAEP Mathematics Project Staff 
and Committees ( 1991 - 1992 ) 



Staff 

The College Board 

Robert Orrill 

Executive Director 
Office of Academic Affairs 

Valerie French 

Director of Curriculum and 
Instructional Development 
Office of Academic Affairs 

Bruce Kennedy 

Office Manager 

Office of Academic Affairs 

Consultants to 
The College Board 

John A. Dossey 

Project Director 
Distinguished University 
Professor of Mathematics 
Illinois State University 
Normal, Illinois 

Cathy Seeley 
Project Coordinator 
Mathematics Consultant 
Former Texas Director 
of Mathematics 
Austin, Texas 



Steering Committee 

Frank Betts 

Director 

Curriculum Technology Center 
Association for Supervision 
and Curriculum Development 
Alexandria, Virginia 

Ed Esty 

Senior Staff Officer 
Mathematical Sciences 
Education Board 
Washington, D.C. 

James Gates 

Executive Director 
National Council of Teachers 
of Mathematics 
Reston, Virginia 

Alice Gill 
Coordinator 
Thinking Mathematics 
Dissemination 
American Federation 
of Teachers 
Cleveland, Ohio 

Joyce McCray 
Executive Director 
Council for American 
Private Education 
Washington, D.C. 
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Henry Pollack 

Visiting Professor 
Teachers College, 

Columbia University 
Formerly with Bell Labs 
New York, New York 

John Porter 

Director 
Education and 
University Relations 
IBM 

Armonk, New York 

Rodney Riffel 

Senior Professional Associate 
National Education Association 
Washington, D.C. 

Ramsay Selden 

Director 
State Education 
Assessment Center 
Council of Chief State 
School Officers 
Washington, D.C. 

Charles Watson 

President 

Association of State 
Supervisors of Mathematics 
Arkansas Director 
of Mathematics 
Little Rock, Arkansas 

Michael Webb 

National Education Director 
National Urban League 
New York, New York 

Gene Wilhoit 

Executive Director 
National Association of State 
Boards of Education 
Alexandria, Virginia 



Planning Committee 

Martha Baca 

Supervisor, K-12 Public 
Schools, and Teacher 
Roosevelt School District #66 
Phoenix, Arizona 

Glen Blume 

Associate Professor 
Penn State University 
University Park, Pennsylvania 

Dave Heckman 

Private School Teacher 
and Presidential Award 
Recipient, 1987 
Monmouth, Maine 

Audrey Jackson 

Middle School Mathematics 
Supervisor and Teacher 
St. Louis, Missouri 

Pat Kenney 

Researcher 

Learning Research and 
Development Center 
University of Pittsburgh 
Pittsburgh, Pennsylvania 

Donna Long 

Indiana State Supervisor 
of Mathematics 
Indianapolis, Indiana 

Larry Wiley 

New Jersey State Supervisor 
of Mathematics 
Trenton, New Jersey 
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